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SYSTEMS AND METHODS FOR VIRTUALLY 
REPRESENTING DEVICES AT REMOTE SITES 

This application claims the benefit of 
Rezvani et al . U.S. Provisional Patent Application 
5 Serial No. 60/230,305, filed September 6, 2000, Rezvani 
et al . United States Provisional Patent Application 
Serial No. 60/247,183, filed November 10, 2000, Rezvani 
et al. U.S. Provisional Patent Application Serial No. 

i 

60/250,034, filed November 29, 2000, and Rezvani et al. 

10 U.S. Provisional Patent Application Serial No. 
60/266,207, filed February 2, 2001. 
Background of the Invention 

This invention relates to systems and methods 
for virtually representing devices at remote sites. 

15 Today, software applications exist that allow 

users to directly control devices using on-screen 
representations of the devices. In one common 
application for personal computers for example, users 
directly control a compact disc (CD) player to play, 

20 stop, rewind and fast-forward CDs using a graphical 

representation of the controls of a CD-ROM player. It 
may be desirable, however, to control a device from a 
remote location. Accordingly, a need exists for a 
system that will allow a device to be controlled by a 
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remote user through a virtual representation of the 
device . 

Summary of the Invention 

In accordance with principles of the present 
5 invention, systems and methods for virtually 

representing and controlling remote devices are 
provided. Various features in accordance with various 
embodiments of the present invention are described, for 
example in Rezvani 

10 et al. U.S. provisional patent application Serial No. 
60/230,305, filed September 6, 2000, Rezvani et al . 
United States provisional patent application Serial No. 
60/247,183, filed November 10, 2000, Rezvani et al . 
U.S. provisional patent application Serial No. 

15 60/250,034, filed November 29, 2000, and Rezvani et al . 
U.S. provisional patent application Serial No. 
60/266,207, filed February 2, 2001, which are hereby 
incorporated by reference herein in their entireties. 

In some embodiments, remote devices may be 

20 represented by parameters, actions, and indicators. 

Parameters, actions, and indicators may be text strings 
that describe or represent various aspects of a remote 
device. For example, a parameter may be a text string 
indicating the name, description, type, or manufacturer 

25 of a device. An action may be a selectable text string 
representing one of the various actions that a remote 
device may take. The text string for an action may be 
associated with one or more commands for a device, 
which may be transmitted to the device when a user 

30 selects the action. An indicator may be a text string 
indicating the status of an aspect of a remote device. 

The parameters, actions, and indicators 
associated with a device may be arranged and presented 
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to a user in any suitable manner. In some embodiments, 
parameters and indicators may be presented to a user as 
text strings on a web page. Actions may be presented 
to a user as, for example, selectable links on the web 
5 page. A user may command a remote device to perform an 
action by 'clicking' the desired action link. 

In some embodiments, remote devices may be 
virtually represented by resources and components. 
Resources and components may be graphical 

10 representations of the physical resources and 

components of a remote device ("members"), and may be 
graphically similar to the resources and components 
that they represent. A template document may be used 
to specify how resources and components may be arranged 

15 and presented to a user. 

In some embodiments,* a combination of 
actions, indicators, resources, or components may be 
used. For example, a component may be labeled with or 
contain an indicator. 

20 In some embodiments, virtual representations 

of devices may be registered. For example, a web 
server may generate data to be used in generating a 
virtual representation of a device from data supplied 
by a database server. This data may include 

25 instructions on how to generate or render a resource or 
component . 

Further features of the invention, its nature 
and various advantages will be more apparent from the 
accompanying drawings and the following detailed . 
30 description of the preferred embodiments. 
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Brief Description of the Drawings 

FIG. 1 is a block diagram of an illustrative 
system in accordance with an embodiment of the present 
invention . 

5 FIG. 2 is a diagram showing an illustrative 

relationship between the database and the web server of 
FIG. 1 in accordance with an embodiment of the present 
invention . 

FIG. 3 is an illustrative block diagram of 
10 some of the components of the illustrative system of 

FIG. 1 in accordance with an embodiment of the present 
invention. 

FIG. '4 is an illustrative block diagram of 
some of the components of the illustrative system of 
15 FIG. 1 in accordance with an embodiment of the present 
invention . 

FIG. 5 shows an illustrative display screen 
depicting a virtual representation of a device using 
parameters, actions, and indicators, in accordance with 
20 an embodiment of the present invention. 

FIG. 6 is a flowchart of illustrative steps 
involved in the registration and display of a virtual 
representation of a device in accordance with an 
embodiment of the present invention. 
25 FIG. 7 shows an illustrative display screen 

depicting a virtual representation of a device using 
templates, resources, and components, in accordance 
with an embodiment of the present invention. 

FIG. 8 is a flowchart of illustrative steps 
30 involved in generating a virtual display using a 

template document in accordance with an embodiment of 
the present invention. 

FIG. 9 is a flowchart of illustrative steps 
involved in the registration and display of a virtual 
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representation of a device in accordance with an 
embodiment of the present invention. 

FIG. 10 is a flowchart of illustrative steps 
involved in associating an installation with a user 
5 account during a registration process in accordance 
with an embodiment of the present invention. 

FIG. 11 is a block diagram of an illustrative 
identification information display screen that may be 
generated by a monitoring module in accordance with an 
10 embodiment of the present invention. 

FIG. 12 is a flowchart of illustrative steps 
involved in the automatic registration of an 
installation in accordance with an embodiment of the 
present invention . 
15 FIG.. 13a is a table of illustrative commands, 

their parameters, and validity checks in accordance 
with an embodiment of the present invention. 

FIG. 13b is an illustrative database schema 
that may be used in accordance with embodiments of the 
20 present invention. 

FIG. 14a is a flowchart of illustrative steps 
involved in the registration of parameters, actions, 
and indicators in accordance with an embodiment of the 
present invention. 
25 FIG. 14b is a flowchart of illustrative steps 

involved in the registration of components, resources, 
and templates in accordance with an embodiment of the 
present invention . 

FIG. 15a is a flowchart of illustrative steps 
30 involved in using handshaking for automatic device 
detection in accordance with an embodiment of the 
present invention . 

FIG. 15b is a flowchart of illustrative steps 
involved with detecting data streams for automatic 
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device detection in accordance with an embodiment of 
the present invention. 

FIG* 16 shows an illustrative registration 
display screen for a service agreement in accordance 
5 with an embodiment of the present invention. 

FIG. 17 shows an illustrative registration 
display screen for requesting information from a user 
in accordance with an embodiment of the present 
invention . 

10 FIG. 18 shows an illustrative registration 

display screen that displays a listing of event 
descriptions and the corresponding notifications set up 
for each even description listing in accordance with an 
embodiment of the present invention. 

15 FIG. 19 shows an illustrative registration 

display screen for showing user-assigned names for 
particular devices in accordance with an embodiment of 
the present invention. 

FIG. 20 shows an illustrative registration 

20 display screen for allowing a user to name an 

installation being registered in accordance with an 
embodiment of the present invention. 

FIG. 21 shows an illustrative registration 
display screen for instructing the user on how to 

25 attach devices to a monitoring module in accordance 
with an embodiment of the present invention. 

FIG. 22 shows an illustrative registration 
display screen for notifying the user of detected 
devices and to allow the user to rename a device in 

30 accordance with an embodiment of the present invention. 

FIG. 23 shows an illustrative registration 
display screen that allows the user to provide 
information communications network being used and to 
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test a connection in accordance with an embodiment of 
the present invention. 

Detailed Description of Embodiments of the Invention 
FIG. 1 shows an illustrative system 10 in 
5 accordance with an embodiment of the present invention. 
For purposes of clarity, and not by way of limitation, 
an illustrative client-server Internet based embodiment 
of the present invention is herein described, but any 
suitable peer-to-peer or other distributed approach may 

10 be used. For example, one computer may have software 
that enables the computer to act as both a web server 
and as a database server. System 10 may include an 
installation 12 and a remote site 14 that may be linked 
via a communications network 16. In practice, there 

15 may be more than one remote site 14 and installation 
12, but only one each is shown to avoid over- 
complicating the drawing. As herein used, the term 
"server" is not limited to a distinct piece of 
computing hardware or storage hardware, but may also be 

20 a software application or a combination of hardware and 
software . 

Remote site 14 may be any suitable remote 
site, and may include various equipment, such as one or 
more servers, mainframes, personal computers, or any 

25 other suitable computer-based equipment. Remote site 

14 may include a network of suitable computers that may 
be interconnected in any suitable way. For example, 
these computers may be interconnected through a local 
area network, wide area network, telephone network, 

30 cable television network, intranet, Internet, or any 
other suitable wired or wireless communications 
network. 
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Communications network 16 may be any suitable 
communications network. For example, communications 
network 16 may be a local area network, wide area 
network, telephone network, cable television network, 
5 intranet, Internet, or any other suitable wired or 
wireless communications network. Some suitable 
wireless communications standards that may be used to 
implement communications network 16 may include global 
system for mobile communications (GSM) , time-division 

10 multiple access (TDMA) , code-division multiple access 
(CDMA) , Bluetooth, or any other suitable wireless 
communication standards. 

Installation 12 and remote site 14 may 
communicate over communications network 16 using any 

15 suitable protocol or protocol stack. For example, 

installation 12 and remote site 14 may communicate via 
the Transmission Control Protocol/Internet Protocol 
(TCP/IP) standard using, for example, IP version 4 or 
IP version 6 (both of which support 128-bit network 

20 addressing) and a hypertext transfer protocol (HTTP) . 
In another approach, universal plug and play (UPnP) 
technology may be used to allow installation 12 and 
remote site 14 to communicate. Any suitable request- 
response type of protocol and socket-based packet 

25 transport stack, or suitable peer-to-peer 
communications approach may be used. 

Installation 12 and remote site 14 may 
communicate using any suitable communications. 
Communications may include, for example, commands, 

30 requests, messages, remote procedure calls (e.g., using 
a proxy-stub pair) , or any other suitable client-server 
or peer-to-peer communication. Communications may also 
involve, for example, complex communications between 
application constructs running on installation 12 and 
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remote site 14. Objects running on the client and 
server may, for example, communicate using an Object 
Request Broker (ORB) . Transmitted information may, for 
example, be encapsulated as COM objects or Javabeans 
5 and persisted to files that are transmitted over a 
remote access link. In another suitable approach, 
access communications may include hypertext markup 
language (HTML) formatted documents (e.g., web pages) 
that are exchanged ' between installation 12 and remote 
10 site 14 via ISP 23 and communications link 16. 



include a series of HTTP posts and responses in which 
the parameters for the transmissions may be sent as 
name/value pairs in the normal post method. In order 

15 to transmit multiple commands in a single command 
string, numbered commands may be parsed out and 
executed at remote site 14. Remote site 14 may be 
responsible for parsing the command string into 
individual commands and executing each of those 

20 commands. To parse commands, remote site 14 may 
utilize a script language and interpreter such as 
Personal Home Page Tools (PHP) that is embedded within 
a Web page along with its Hypertext Markup Language 
(HTML) . For example, before a page is sent to the 

25 requesting user, web server 46 may call PHP to 

interpret and perform the operations called for. Other 
similar technologies may also be utilized such as 
JavaScript, Microsoft's VBScript, or any other 
applicable script interpreter. If desired, any other 

30 suitable client-server or peer-to-peer based approach 
may be used. 



user. Installation 12 may include one or more nodes. 
For purposes of clarity, and not by way of limitation, 



As another example, communications may 



Installation 12 may be operated by a local 
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FIG - 1 illustrates an approach having two nodes, first 
user node 18 and second user node 20. It should be 
understood, however, that any number of nodes may be. 
used. Additionally, nodes 18 and 20 may be located at 
5 a single location, such as the user's main residence. 
If desired, nodes may be located across more than one 
location. For example, one node may be in a user's 
main residence and another at the user's vacation 
house. In embodiments where user accounts are 

10 provided, nodes of an installation may be associated 
with more than one user account. 

In some embodiments of the present invention, 
user node 18 may include a client device 22 that may be 
connected to communications network 16. In Internet- 

15 based approaches, such as in the embodiment shown in 
FIG. 1, client device 22 may be connected to the 
Internet via an Internet service provider (ISP) 23. 
Client device 22 may be any device suitable for 
communicating with remote site 14 via communications 

20 network 16. For example, client device 22 may be a 
computer, a personal digital assistant (PDA) , a 
terminal, a set-top box, or any other suitable device 
that provides access to remote site 14 via 
communications network 16. Client device 22 may 

25 include, for example, an Internet browser application 
2 6 that may be used to access web pages via 
communications network 16. In other suitable 
approaches, client device 22 may run a client 
application that provides locally generated displays 

30 propagated with a format obtained using any suitable 
client-server or peer-to-peer scheme. 

Client device 22 may communicate with ISP 23 
or directly with communications network 16 using any 
suitable communications link. For example, the link 
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may include a telephone dial-up link, digital 
subscriber lines (DSL), a cable modem link (e.g., a 
data over cable service interface specification 
(DOCSIS) ) , a satellite link, a computer network link 
5 (e.g., Ethernet link, Tl line, etc.) or any other 
suitable communications link or combination of 
communications links . 

Remote site 14 may include one or more 
servers. For example, remote site 14 may' include web 

10 server 46 and database server 48. Database server 48 
may maintain database 58. In other suitable 
approaches, such as non-Internet based approaches, 
remote site 14 may include an application server and 
any other suitable server or combination of servers. 

15 Generally, communications between database 

server 48 and web server 4 6 may be accomplished using 
API functions, as shown in FIG. 2. Web server 46 may 
call a particular API function that causes the database 
to be accessed. The API may then return a value (in 

20 accordance with the specification of the particular 
function) that is sent to web server 46. This is 
merely an illustrative way of allowing web server 46 to 
interact with database server 48. If desired, any 
other suitable way of allowing the web server to 

25 interact with the database may be used. Although the 
illustrated system uses APIs as an interface between 
database server 48 and web server 4 6, other suitable 
technologies may be used. For example, Perl scripts, 
CGI scripts, Cold Fusion, or any other suitable 

30 technologies, or combination thereof, may be used to 
interface database server 48 with web server 46. 

In some suitable approaches, remote site 14 
may provide displays or display definitions to client 
device 22. In the Internet-based approach of FIG. 1, 



for example, web server 4 6 may generate static and 
dynamic web pages from data supplied by database server 
48. Web page 47 may be viewed by a user using Internet 
browser 26 running on client device 22. 

Software applications that interface 
installation 12 with remote site 14 may be created 
using any suitable platform and/or software development 
tools. For example, Java 2 Enterprise Edition, 
Javabeans, component object model (COM) based 
technologies (e.g., ActiveX, object linking and 
embedding (OLE), etc.), JavaScript, Visual Basic, C, 
C++, scripting languages, or any combination of these 
or other suitable development tools may be used. In 
addition, any suitable combination of these or other 
suitable development tools may be used in preparing 
other software modules or applications for the various 
embodiments of the present invention. 

Remote site 14 may function as the master 
controller of system 10. In addition, users may access 
system 10 via any computer, monitoring module, or 
remote user access device linked to communications 
network 16. Remote user access devices (such as remote 
user access device 17 in FIG. 1) may include, for 
example, personal digital assistants, cellular 
telephones, set-top boxes, personal computers, or any 
other suitable device, a user may use to access remote 
site 14 via communications network 16. 

Monitoring modules 28 may serve as an 
interface between remote site 14 and at least one 
connected device 32. Monitoring modules 28 may be any 
suitable hardware, software, or a combination thereof 
and may be included at any point within the system. 
For example, monitoring module 28 may be a software 
application running on client device 22 or a separate 
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piece of hardware that may be connected to client 
device 22 (as shown at node 18) or partially 
implemented as software on client device 22 and a 
separate piece of hardware. In some embodiments, 
5 monitoring module 28 may be a stand-alone appliance (as 
shown at node 20) connected to communications network 
16, operating separately and independently from client 
device 22. Each monitoring module 28 may be shipped 
with a model identification code, or with the capacity 
10 to generate such a code, that may serve to identify 
each particular monitoring module's model type. 



installed at one or more locations. Monitoring 
modules 28 may be installed by the user (or any other 

15 suitable person) by, for example, connecting the 

modules to client device 22, and may communicate with 
remote site 14 over communications network 16. The 
connection between the monitoring module 28 and the 
client access device and between devices and the 

20 monitoring module may be in the form of a universal 

serial bus (USB) connection, parallel port connection, 
serial connection (e.g., RS-232), Firewire connection, 
any combination of these, or any other suitable type of 
connection. If desired, monitoring modules 28 may be 

25 given the capability (e.g., processing hardware, 

communications equipment, etc.) to communicate, via 
communications network 16, without the use of a client 
access device. 



30 devices or appliances (e.g., sensors, cameras, 

microwaves, refrigerators, etc.) with remote site 14 
via communications network 16. One or more monitoring 
modules 28 may provide data from attached devices and 
appliances to remote site 14 via communications network 



One or more monitoring modules 28 may be 



Monitoring modules 28 may link attached 
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16. The term "device," as defined herein, shall 
include any suitable device or appliance. At least one 
device 32 may be interfaced with and controlled by each 
monitoring module 28. Connections between monitoring 
5 module 28 and the various devices 32 may be hardwired 
or wireless (e.g., using Bluetooth technology). 

Devices 32 may encompass any suitable device 
capable of being controlled or mediated by an external 
controller. Such devices may include, but are not 

10 limited to, a camera 34, a radio 36, a smoke or fire 
detector 38, a contact sensor 40, and a light switch 
41. Although not illustrated, other suitable devices 
may include, for example, various audio input and 
output devices, infrared devices and sensors, various 

15 visual displays, washers/driers, microwave ovens, 

cooking ranges, car alarms, plant watering devices, 
sprinklers, thermostats, carbon monoxide sensors, 
humidity sensors, water emersion sensors, radon 
sensors, temperature sensors, audio sensors, radiation 

20 sensors, rain gauges, video cassette recorders, radio 
tuners, or any other suitable device and the like. 

One or more notification devices, such as 
pager 43, may also be incorporated into the system. As 
illustrated in FIG. 1, pager 43 is communicating 

25 wirelessly with a wireless or cellular transmitter 44 
associated with remote site 14. Other suitable 
notification devices include, for example, e-mail 
clients, wireless hand-held computers,' wireless 
wearable computer units, automatic web notification via 

30 dynamic web content, telephone clients, voice mail- 
clients, cellular telephones, instant messaging 
clients, and the like. Notification devices may 
receive notification of events within the system and 
indicate such events to the user. 
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System 10 provides users with opportunities 
to remotely control and monitor devices 32 using remote 
user access devices 17 via communications network 16. 
In the example of FIG. 1, users may control devices 32 
5 that are interfaced with monitoring modules 28 at node 
18 and devices 32 interfaced with monitoring module 28 
at node 20. In practice, there may be a single node, 
or more nodes, depending on, for example, the user's 
equipment, number of sites, or other suitable 

10 parameters. In practice, any suitable system 

architecture and communications network 16 may be used 
to allow users, or anyone that users permit, to readily 
monitor and control monitoring modules 28 from any 
location using any suitable device that is capable of 

15 communicating with remote site 14 via communications 
network 16. 

In another suitable approach, users may 
access installation 12 using remote user access 
devices 17 without the use of remote site 14. For 

20 example, remote user access devices 17 may be used to 
communicate with monitoring modules 28 of installation 
12 via communication network 16 and ISP 23. If 
desired, two-way communications may be implemented 
using this approach. Remote user access device 17 may 

25 access installation 12 using, for example, special IP 
addresses assigned to a particular monitoring module, 
node, installation, or any other suitable element of 
the installation. The use of IP addresses is merely 
illustrative. Any other suitable addressing or other 

30 communications pro'tocol may be used to allow access to 
an installation from a remote used access device. 

Devices 32 may be programmed at the 
installation with respect to how they respond to 
certain events. Alternatively, devices 32 may be 
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programmed from a remote location using remote user 
access device 17, for example. The programming may be 
stored in devices 32, monitoring modules 28 , or at 
remote site 14. 
5 Referring now to FIG. 3, monitoring module 28 

may serve, for example, as a common connection point 
for one or more devices 32 at an installation 12 and as 
the interface between devices 32 and remote site 14 via 
communications network 16. Monitoring module 28 may, 

10 for example, serve as a translation and brokering agent 
between remote site 14 and. devices 32. 

In some embodiments, monitoring module 28 may 
be software made up of multiple dynamically loaded 
objects, or device descriptors 49, that may allow 

15 remote site 14 to interface with the devices 32. The 
dynamically loaded device descriptors 49 may act as 
device drivers for devices 32, translating, in both 
directions, monitoring, command, and control data 
(i.e., via monitoring module 28) exchanged between 

20 devices 32 and remote site 14 via communications 
network 16. Each device descriptor 49 may also 
translate the signals received from monitoring module 
28 into the specific electrical signals that are 
required to communicate with (both input and output) 

25 and control its associated device 32. Device 

descriptor 49 may be provided for each specific 
device 32 when, for example, different devices 32 have 
different interfaces and require specific sets of 
electrical signals for their monitor and control. 

30 Device descriptors 49 may include, for 

example, a manufacturer identification, product 
identification, and driver version number to allow a 
device to be referenced correctly. Once a new 
device 32 has been detected and is to be integrated 
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into the system, monitoring module 28 may reference, 
download, and run the appropriate drivers for the new 
device. 

After loading a new descriptor 49, monitoring 
5 module 28 may communicate with remote site 14 to 

determine whether the new device 32 has been previously 
catalogued. Monitoring module 28 may, for example, 
determine if a general description and a default state 
of device 32 exists at the remote site. When a 

10 device 32 has been catalogued, then, for example, the 
default state and general parameters of device 32 may 
be stored at remote site 14. A catalogued device 32 
may eliminate the need to resend the general parameters 
and default state and monitoring module 28 may just 

15 communicate the instance-specific parameters. When a 
device 32 is not already catalogued, device 32 may 
communicate its default state and static parameters to 
monitoring module 28 that may, in turn, communicate the 
default state and static parameters to remote site 14. 

20 The communication from monitoring module 2 8 to remote 
site 14 may be done using name/value pairs using, for 
example, the normal HTTP post method discussed 
hereinbefore. For example, a template document may be 
a static parameter of device 32. Template documents 

25 are discussed in detail below. 

In some embodiments, monitoring module 28 may 
persist the state of devices 32. This may be done, for 
example, to allow the real-time states of devices 32 to 
be stored, to communicate to remote site 14, or to 

30 allow for easy recovery from a system crash. The 

stored state of devices 32 may be used, for example, to 
maintain a synchronized relationship between an 
installation 12 and remote site 14. In some 
embodiments, remote site 14 and installation 12 may use 
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polling and heartbeat mechanisms in order to 
synchronize state information between remote site 14 



and installation 12. 



Polling' may refer to a process whereby 



5 monitoring module 28 obtains commands from remote site 
14. The commands may reside, for example, in command . 
queue 51. Commands may be accumulated at command queue 
51 as a result of any suitable action by the user, by 
remote site 14, or by both. For example, a user may 

10 use a remote user access device to issue a command or a 
request to remote site 14 to cause a change in state of 
one of devices 32 (e.g., to turn a lamp on) . Remote 
site 14 may post the change in state command to a 
command queue 51. 

15 Monitoring module 28 may communicate a 

request for pending commands to remote site 14. This 
request may, for example, be communicated periodically 
as part of the polling process. In response to the 
monitoring module's request, remote site 14 may provide 

2 0 one or more pending commands from command queue 51, and 
may notify monitoring module 28 of the number of 
remaining pending commands in command queue 51 . 
Monitoring module 2 8 may then communicate another 
request for pending commands. Remote site 14 may 

2 5 return more of the pending commands from command queue 
51. This process may continue until command queue 51 
at remote site 14 is empty. 



monitoring module 28 using any suitable algorithm. For 
30 example, remote site 14 may return commands using 

first-come, first-serve, round robin, first-in, first- 
out, weighted prioritization, or any other suitable 
algorithm. Remote site 14 may also proactively inform 
monitoring module 28 that commands are waiting in 



Remote site 14 may provide commands to 



# 



- 19 - 

queue 51. Monitoring module 28 may then poll remote 
site 14 and retrieve commands from remote site 14 until 
the queue is empty. 

Commands issued on remote site 14 can be 
5 generated by the user while the user is logged on to 
web page 47 provided by remote site 14. If a user is 
not logged onto web page 47 then fewer commands are 
being issued and thus the need to poll remote site 14 
is low. Therefore, the frequency of polls may 

10 decrease. In addition, a poll frequency setting 

process may monitor the usage patterns of a user and 
set a suitable frequency based on the user's pattern of 
command generation. For example, the user may not 
often be logged on to web page 47 at remote site 14 

15 ' from the hours of 2 AM to 7 AM because the user is 
sleeping. Therefore, the smart frequency setting 
process may detect this pattern and automatically 
decrease the poll frequency at 2 AM and increase it 
again at 7 AM. 

20 Whereas polling process 50 is used by remote 

site 14 to effect state changes in devices 32 via 
monitoring module 28, monitoring module 28 may use 
heartbeat process 52 to update device state information 
at remote site 14. A heartbeat may be a periodic 

25 communication from monitoring module 28 to remote 
site 14 containing updated state information for 
devices 32 associated with monitoring module 28. In 
one suitable heartbeat process 52, monitoring module 28 
may send a communication to remote site 14 in response 

30 to a change in state of a device 32, a synchronization 
of a device 32 with remote site 14, a triggered alert 
event, or in response to any other suitable event. In 
such a heartbeat operation 52, all data intended to be 
transmitted to remote site 14 may be transmitted to 




- 20 - 

remote site 14 via communications network 16. Remote 
site 14 may transmit an acknowledgment of receipt and 
successful processing of the data back to monitoring 
module 28. 

5 Remote site 14 may direct monitoring 

module 28 to make changes in its own state by, for 
example, posting commands to data store 51. For 
example, remote site 14 may post commands that set or 
modify the polling 50 or heartbeat 52 time intervals. 

10 Upon reaching the end of the current polling interval, 
monitoring module 2 8 may send a communication to remote 
site 14, requesting any queued commands. Monitoring 
module 28 may continue to poll, using any suitable 
communication scheme, until the queue of commands 

15 waiting for monitoring module 28 is empty. Each 

command received from the queue may be acted upon when 
the command is received and any associated state 
changes are effected. Remote site 14 may transmit an 
acknowledgment of receipt and successful processing of 

20 the data back to monitoring module 28. 

If desired, remote site 14 may send 
unsolicited communications to monitoring module 28. 
Remote site 14 may send communications to, for example, 
set or update the heartbeat or polling time, or to 

25 cause monitoring module 28 to issue a command to update 
a component of a device. Remote site 14 may send 
unsolicited communications to monitoring module 28 for 
any other suitable purpose. 

In addition to maintaining the polling and 

30 heartbeat operations and exchanging communications for 
events, data, and commands 54 with remote site 14, 
monitoring module 28 may manage network level 
activities 56. These activities may include, but are 
not limited to verifying passwords, dialing up an ISP, 
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if necessary, periodically uploading accounting/billing 
information, and performing security measures. Any 
other suitable network level activities may be 
performed by monitoring module 28. 
5 Monitoring modules may register themselves, 

devices, or installations with remote site 14. 
Illustrative systems and methods for auto-registering 
devices with remote sites are described, for example, 
in Rezvani et al . United States patent application 
10 Serial No. 09/709,688, filed November 10, 2000, which 
is hereby incorporated by reference herein in its 
entirety. 

The following examples will illustrate how 
users may remotely control various devices. For 

15 example, contact sensor 40 of FIG. 1 may be associated 
with the front door (not shown) of a remote location 
associated with second node 20. Contact sensor 40 may 
be configured to trip whenever the front door is 
opened. Camera 34 may be positioned to view the front 

20 door location and may be programmed to take a digital 
picture whenever the sensor contact 40 is tripped. 
This picture may be transmitted over communications 
network 16 and stored in database server 48. When 
contact sensor 40 detects that the front door has been 

25 opened, an event notification or alarm trigger may be 
transmitted by monitoring module 28 to database server 
48. Database server 4 8 may have been previously 
programmed to transmit a notification event to the 
user's pager, for example, via cellular transmitter 44. 

30 As the contact sensor is tripped, camera 34 may take a 
picture of the front door and may transmit that 
picture, via monitoring module 28 and communications 
network 16, to database server 48. The user, having 
been notified via pager 42, may now access the picture 
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using web server 46 of remote site 14 via Internet 
browser 26. In this way, the user may determine who 
has entered the front door of his or her home. 

As another example, system 10 may allow a 
5 user located at one node 18 to control a device at a 
second node 20. The user may contact web server 46 
via, for example, Internet browser 26 of node 18 in 
order to access a database entry for light switch 41 of 
node 20. A virtual representation of the light switch 

10 41 may be made available to the user by web server 4 6 
and may be manipulated by the user to remotely change 
the state of light switch 41 and the connected lamp 42. 
For example, the system may allow the user to change 
the state of lamp 42 from being "off" to being "on" by, 

15 for example, manipulating the virtual light switch from 
web server 4 6 and a corresponding command would be 
placed in a queue of waiting commands on the server 
component . 

Periodically, the controlling module or 
20 monitoring module 28 may poll remote site 14 looking 

for pending commands, such as the change state command 
of light switch 41. Thereafter, the command may be 
transmitted to monitoring module 28 that would instruct 
the light switch to change from the "off" state to the 
25 "on" state, thus turning on lamp 46. A feedback 

mechanism may be used to indicate to the remote site 14 
whether the command was executed. For example, the 
change in state of lamp 46 may be viewed by an 
appropriately positioned camera, such as camera 34, 
30 which would be used to visually monitor the remote 

location 20 to determine whether the command had been 
completed successfully. If the command had not been 
successfully completed, then an error message may be 
communicated to the user, using for example, the means 
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specified by the user's notification preferences or 
through any other suitable means of communicating 
information to the user. 

FIG. 4 further illustrates the relationship 
5 between devices, monitoring modules, and remote 

database server 48. FIG. 4 shows five devices, 32, 
32a, 32b, 32c, 32d. In practice, there may be any 
number of devices with each installation. Each device 
may be interfaced to a monitoring module 28 via a 

10 device descriptor or driver 49 (for clarity, only one 
is shown) . Each device may also be represented by a 
customizable user interface 58 that may be viewable on 
a remote user access device over communications network 
16. Interfaces 58 may include virtual representations 

15 of the actual physical user interface of a device. In 
some embodiments, virtual representations may be stored 
on web server 46. Remote site 14 may use changes in 
the state of a device to change the virtual 
representations of the devices with which the changed 

20 states are associated. 

A virtual representation of a device may be 
either a text-based, symbol-based, or image-based 
representation of an actual device 32. For example, 
and as discussed in greater detail below, if the device 

25 is a light switch, the corresponding virtual 

representation may include a text string that states 
"light on", or it may be an icon that may be either 
green or red. If the icon is green, that may denote 
that the actual light switch is in the "on" position. 

30 If the icon is red, that may denote that the light 
switch is in the "off" position. If, during a 
heartbeat operation, remote site 14 is informed that 
the state of the light switch changes from "on" to 
"off, " then the virtual representation of the light 
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switch may change from indicating an "on" state to an 
"off" state (i.e., the text string may state "light 
off" or the icon may change from being green to red.) 
In other embodiments, a virtual representation may.be a 
5 combination of text and graphics. 

In some embodiments, virtual representations 
may be textual representations of devices. An example 
of such a virtual representation is shown in FIG. 5. 
In this embodiment, the textual representations may 

10 include parameters, actions, and indicators. 

Parameters, actions, and indicators may be text strings 
that describe or represent various aspects of a remote 
device. Parameters may include any suitable informa- 
tion regarding a device. In some embodiments, 

15 parameters for a device may include the name, 
description, type, or the manufacturer of the 
device 32. For example, the device 32 may be a camera. 
The parameters 2320 for the camera may include the 
camera's name, description, type, and manufacturer 

2 0 name . 

Actions may include any suitable action that 
a device 32 may take, or any suitable commands that may 
be transmitted to a device. In some embodiments, an 
action may be a selectable text string on a web page 

25 representing one of the various actions that a device 
may take. Actions 2300 for a camera may include, for 
example, "increase brightness," "decrease brightness," 
"pan left," "pan right," "turn on," "turn off," "turn 
on microphone," and "turn off microphone." A user may 

30 command the camera to turn up the brightness by 

selecting an appropriate link on a web page, which may 
read "turn up brightness". The command associated with 
a particular action link may be different from the 
description of the action link that is displayed on the 
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generated web page. For example, an action link that 
is displayed as "turn on camera" may correspond to a 
command to check to see if the camera is on, and a 
conditional command to turn on the camera if it is off. 
5 Indicators may provide information regarding 

particular feedback from a corresponding device 32 that 
may be displayed to a user. In general, indicators may 
include, for example, a name and a value. The name may 
indicate the label of the indicator to be displayed to 

10 a user and the value may indicate the state of that 
indicator. The indicators 2310 for a camera may 
include, for example, "pan position, " "tilt position, " 
"brightness level," "power status," "microphone on," 
"microphone level, " and "last time motion sensor 

15 tripped". 

Indicators may be periodically updated (e.g., 
during a heartbeat operation) to reflect the current 
status of a device. For example, after a user selects 
the command to turn up the brightness of a camera, an 

20 indicator may be updated to read "brightness = y, " 

where y is the current brightness of the camera. As 
another example, an indicator may indicate the frame 
rate of a video camera. A name for such an indicator 
may be "Frame Rate". 

25 In some embodiments, different actions and 

indicators may be selectively displayed to a user based 
on specific criteria. These preferences may be set 
automatically by the user during registration, which is 
discussed in more detail below. For example, a user 

30 may desire to have actions and indicators displayed in 
English. Accordingly, actions and indicators that are 
English may be chosen by database server 48, client 
device 22, or any other suitable retrieval script or 
program, and displayed. Similarly, if actions and 
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indicators are to be displayed in another language, 
such as Spanish, then Spanish actions and indicators 
may be chosen by database server 48, client device 22, 
or any other suitable retrieval script or program, and 
5 displayed. In another embodiment, actions and 

indicators may be configured for display on a specific 
device. For example, one web page may be generated 
that may be appropriate for a computer using an 
Internet web browser, and another web page may be 
10 generated for a device with a much smaller display, 
such as a PDA or a WAP enabled cell phone. 



illustrative steps involved in the use and display of a 
virtual representation of a device using parameters, 

15 actions and indicators in accordance with an embodiment 
of the present invention. During the registration 
process, a device 32 may register information regarding 
its parameters actions, and indicators (step 2000) . 
Registration may include, for example, those steps of 

20 FIG. 14a as discussed below. 



access the device 32 (step 2010), web server 46 may 
generate a web page 47 in step 2020 by retrieving the 
associated record for the device and user from database 

25 server 48. In some embodiments, the generated web page 
47 may indicate actions associated with the device as 
links on a web page ("action links"). In this example, 
the web page 4 7 generated for the camera may include 
the action links "increase brightness, " "decrease 

30 brightness," "pan left," "pan right," "turn off," "turn 
on," "turn on microphone," and "turn off microphone". 
The web page 47 generated for the camera may also 
include the indicators for that device. These 
indicators may be included on the web page as text 



FIG. 6 depicts a flowchart of general, 



In response to a user indicating a desire to 
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strings on web page 47. For example, the web page 47 
may include the text strings "pan position = a", "tilt 
position = b" , "brightness level = c" , "power status 
= d" , "microphone on = e", "microphone level = f" and 
5 "last time motion sensor tripped = g", where a, b, c, 
d, e, f, and g are data corresponding to a particular 
indicator. The indicator may also be an audio 
indicator, such as, for example, a .wav file, or any 
other suitable audio indicator. Similarly, the 

10 indicator may be a static graphical representation, 
such as a . gif file, or any other suitable static, 
graphical representation . 

In response to a user indicating a desire to 
select an action link in step 2030, a command (or 

15 commands) associated with the action link may be 

transmitted to the device (in the present example, a 
camera) . In this example, the user may select 
"increase brightness".' In response, a command may be 
stored on the database server 48 in step 2050. The 

2 0 command may then be provided to the device 32 in step 
2060, which will in turn execute the command and 
increase its brightness level in step 2070. The camera 
device 32 may then generate data indicating that the 
camera brightness has been increased in step 2080. The 

25 data from the indicator may be provided to the database 
server 48 as, for example, discussed above. 
Subsequently, this data may be retrieved by web 
server 4 6 and used in generating an appropriate 
indicator on web page 37 in step 2090 as, for example, 

30 discussed above. 

In other embodiments, virtual representations 
may be graphical. For some of these embodiments, the 
graphical representations may include resources and 
components. FIG. 7 shows an illustrative display 
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screen depicting a virtual representation of a device 
using resources and components. 

Resources may provide users with access to 
features specific to a device. A resource may include 
5 one or more components (e.g., resource 2400). A 

component (e.g., components 2 410) may be an object that 
includes methods and data that may be used to generate 
and define the graphical representation of the 
component (a "display component"). The display 

10 component may correspond to a "physical" component on 
device 32 (a "member"). A virtual representation of a 
device may include only resources, only components, or 
any suitable combination thereof. In some embodiments, 
components may include actions, parameters or 

15 indicators. 

Display components may represent a variety of 
different members. For example, display components may 
represent (or be displayed to a user as) toggle 
buttons, radio buttons, absolute sliders, proportional 

20 sliders, edit fields, labels, images, streaming video, 
streaming audio, time fields, date fields, edit fields, 
labels, images, video clips, multiselect list, N- 
directional components, N-state buttons, N-state 
selectors (where N may be any suitable integer) , trees, 

25 tables, graphs, charts, drawing pads, banners, or any 
other suitable display components. 

Display components may act as status 
indicators. Display components may allow users to 
toggle settings or otherwise control devices 32. For 

30 example toggle buttons may indicate, for example, 
whether a device is in the "on" position or in the 
"off" position. Toggle buttons may allow users to 
change the state of a device, by, for example, turning 
a device on or off. Sliders may indicate the 



# 
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percentage complete of a particular process a device 
may be performing (e.g., baking a cake), and may allow 
users to change the state of a device (e.g., changing 
oven temperature) . Edit fields may allow users to 
5 change textual representations of suitable elements 
(e.g., naming a television show to be recorded by the 
show's name). Video, audio, images, or any other 
suitable media-based components may indicate what the 
devices are sensing (e.g., images may be sensed by 

10 cameras, streaming video may be sensed by camcorders, 
audio clips may be sensed by audio recorders, etc.) . 
Date and time fields may indicate what date and time a 
VCR is set to start recording. Date and time fields 
may allow users to set the date and time a VCR may 

15 start recording. Multiselect lists may indicate all 
sound sensors that are detecting noise in the house. 
Multiselect lists may also be used, for example, to 
select some of a number of available sensors to turn 
on . 

20 In order to display the current state of a 

device,, a remote client access device may be provided 
with appropriate information by a monitoring module for 
propagation into the user interface. For example, 
referring back to FIG. 3, the state of a light switch, 

25 volume of a speaker, or the actual video from a video 
camera may be provided by monitoring module 28 to 
client access device 22 or remote site 14 and indicated 
in web page 47. 

Moreover, users that access a virtual 

30 representation of a device may make any suitable 
changes to the individual components (e.g., that 
correspond to state changes of the corresponding 
device) and those changes may be communicated to 
monitoring module 28. In some embodiments, the actual 
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state of components may not be altered in database 58 
when the changes are issued by users through, for 
example, browser 26. Rather, upon monitoring module 28 
receiving state changes via, for example, packaged 
5 commands from queue 51, the commands may be delivered 
to an appropriate device descriptor 49. Device 
descriptor 49 may be responsible for communicating a 
command to remote site 14 for the purpose of updating 
database 58 with the respective state changes. The 

10 communication from device descriptor 49 may confirm the 
acceptance of the state changes. Changes in display 
components of a device's virtual representation may 
signal that a corresponding change is or has been 
performed in physical device 32. 

15 Generally, resources or components may also 

include data or instructions representing the actions, 
the resources or components may take, and how the 
resources or components may indicate the status of 
their corresponding member on device 32, and parameters 

20 of the member. For example, resource 2400 includes a 
display component 2410 that includes a series of 
pushbuttons 2411, 2412, 2413, 2414 which a user may use 
to activate the VCR's play, stop, reverse and fast 
forward, respectively. Resource 2420 may include 

25 pushbuttons 2421, 2422, 2423, and 2424 that a user may 
use, respectively, to activate up channel and down 
channel functions and to increase or lower the volume 
functions of the VCR. The power resource 2430 may 
include a toggle switch component 2431 that users may 

30 use to activate the VCR's power on and power off 

commands, and an LED indicator 24 32 that may indicate 
the power condition of the VCR. 

Resources and components may also have 
additional functionality that is not indicated by the 
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physical interface of a given device. For example, a 
VCR may not have a button programming regularly 
scheduled media. This functionality, however, may be 
represented in the virtual interface using resources or 
5 components. Furthermore, display resources or 

components that represent device 32 may be incorporated 
to correspond to functionality that may not exist on 
the device. A button represented on the user interface 
through web page 47 that "locks" down a VCR, for 

10 example, may not correspond to a physical button on the 
VCR. The unavailable functionality on the VCR may 
allow the user to remotely access his or her VCR to 
lock it for the purpose of protection. Such a resource 
or component may be created in, for example, the device 

15 driver in monitoring module 28. 

In some embodiments, templates may be used in 
creating virtual representations. A template is a 
layout document that can specify how resources and 
components may be arranged and displayed to a user in a 

20 display (e.g., user's web page 47 at remote site 14). 
Templates may exist at any suitable point in a given 
system as either static or dynamic documents. For 
example, templates may be downloaded from a remote 
server at registration. The ability to download 

25 templates from a remote server (e.g., a device 

manufacturer's server) may permit a third party (e.g., 
the manufacturer) to incorporate desired changes and/or 
new aspects in the device template. Templates 
incorporating static parameters may exist as a static 

30 parameter inside the hardware of device 32, as a static 
parameter within the driver and setup during 
registration procedures, may be hard-coded into a 
remote server, or may be communicated through 
monitoring module 2 8 via the device drivers and stored 
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on the user's account. Templates may also be stored on 
any suitable media and downloaded at registration. For 
example, a template may be stored on a floppy disk, 
optical disk, or any other suitable media, and 
5 downloaded at registration. Any other suitable 
approach may be used. 

A markup language, such as SGML, HTML or any 
other suitable markup language, may be used to generate 
a template. A template may specify how resources and 

10 components may be arranged through the use of place 
holders. A place holder may take the form of 
<component id = XX>, where "id" may be used to 
designate a particular component. The place holder may 
be followed with code (e.g., HTML code, JavaScript, 

15 etc.) that may include state information of the 

particular resource or component, or any other suitable 
information. These place holders may indicate where in 
a virtual representation a resource or component should 
appear . 

20 FIG. 8 depicts illustrative steps involved in 

one embodiment for generating a virtual representation 
using a template document. In step 2200, a request or 
other indication is received from remote user access 
device 17 or client access device 22 that a user wishes 

25 to access (i.e., monitor or control) a device 32. In 
response to this request, one or more templates, 
resources, or components may be retrieved by database 
server 48, client access device 22, or any suitable 
retrieval program or script using any suitable approach 

30 (step 2210) . For example, database server 48, client 
device 22 or any other suitable retrieval program or 
script may retrieve appropriate templates, resources, 
or components from its own storage or from another 
database server (e.g., from the Internet), using URLs 
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or other identifiers of the templates, resources, or 
components. In some embodiments, devices 32 may be 
programmed with the templates and components or 
resources and may provide them to client access 
5 device 22 or database server 48. 

Once the resources and components are 
retrieved, the functions necessary to display the 
display resources and components may be cut and pasted 
into the template (step 2220). In one embodiment, this 

10 may be accomplished by using the retrieved resources or 
components as inputs into a representation assembly 
function. The assembly function may then assemble 
appropriate code that can generate a display resource 
or component (i.e., "rendering code") into the 

15 template. For example, the assembly function may 
replace the place holders of the template with 
rendering code. In another embodiment, the rendering 
code may be part of the resource or component. 
Database server 48, client access device 22, or any 

20 other suitable retrieval script or program may retrieve 
the rendering code from the resource or component, and 
cut and paste it into the proper place of the template 
document. The rendering code may be written in any 
suitable language, such as C, C++, Java, or Perl. 

25 Once the rendering code has been cut and 

pasted, the template may be transmitted to a remote 
access device (step 2230) . In step 2240, the rendering 
code may be executed, and a display resource or 
component generated, thus rendering the desired virtual 

30 representation. A browser (or any other suitable 
interface) may be loaded to display the virtual 
representation of the device. 

The rendering code may be executed to 
generate a display resource or component in any 
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suitable manner. In one approach, the rendering code 
may be executed as a Java function on the remote user 
access device. This approach may be suitable when, for 
example, the use of a cross-platform interpreter (such 
5 as Java) is desirable or available. In another 

approach, the rendering code may be a self-contained 
executable program encapsulated in the template that, 
when called, may render the appropriate resource or 
component. This approach may be may be suitable in 

10 instances where, for example, a. cross-platform 

interpreter is either undesirable or unavailable. 

In some embodiments, several templates may be 
available for a device, each including place holders 
for different resources or components. Each template 

15 may be appropriate for different circumstances. The 
database server 48, client access device 22, or any 
other retrieval program or script may select an 
appropriate template, depending on the circumstances. 
For example, if a virtual representation is to be 

20 displayed in English, a template may be chosen by 

database server 48, client device 22, or any suitable 
retrieval program or script that includes placeholders 
for resources and components that have English text. 
Similarly, if the virtual representation is to be 

25 displayed in another language, such as Spanish, then a 
template may be chosen that includes placeholders for 
resources and components that have Spanish text. 

In some embodiments, different templates for 
a particular device may be selected depending on where 

30 the virtual representation is being displayed. For 
example, a template may be selected for a computer 
using a web browser, while another template may be 
selected for a device with a much smaller display, such 
as a PDA, or a WAP enabled cell phone. 
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FIG. 9 depicts a flowchart of general, 
illustrative steps involved in the use and display of a 
virtual device using components, resources, and 
templates in accordance with an embodiment of the 
5 present invention. 

Information that may be registered regarding 
a resource or component may include general information 
or specific information, or any other suitable 
information. General information may include, for 

10 example, an identification label for the component, 

whether the component is editable (i.e., whether it may 
be manipulated by the user) , or whether the component 
is active. Specific information may be device 
specific. For example, the device may be a light. The 

15 light device may include a component that is a slider, 
which may control brightness level, for example. 
Specific information pertaining to the slider that may 
be registered by the device 32 may include the high 
range of the slider, the low range of the slider, the 

20 increment that the slider should move when dragged 

(e.g., in increments of 1, 10, etc.), or the number of 
marks telling the user where the slider is positioned. 
Devices may also register other data or instructions 
representing the actions a component may take, and how 

25 the component may indicate the status of its 

•corresponding member on device 32, and parameters of 
the member. As another example, a device 32 may be a 
camera. The camera device may include a directional 
component for controlling the pan and tilt of the 

30 camera lens, a first slider component for controlling 
recording volume, a second slider component for 
controlling the tilt of the camera, and a button 
component for turning the camera's power on and off. 
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Returning now to Fig. 9, in step 2100, the 
components, resources, and templates associated with a 
device may be registered in database 48 during the 
registration of the device 32. Registration may 
5 include, for example, those steps as discussed below in 
FIG. 14b. A device may be capable of registering 
.information about itself. Accordingly, in step 2100, 
the device may register information regarding its 
components, templates, and resources. -In some 
10 embodiments the processes and protocols used to 

register components may be different than the processes 
and protocols used for the registration of parameters, 
actions, and indicators. 

In this example, camera device 32 may 
15 register general information for each component. The 
camera device may also register specific information 
for each component. By way of example, this may 
include the minimum value of the horizontal pan; the 
maximum value of the horizontal pan; the minimum value 
20 for the vertical pan; the maximum value for the 

vertical' pan; the horizontal increment that the pan 
component should move when selected; the vertical 
increment that the component should move when selected; 
the normal, or "home" value of the horizontal pan; and 
25 the normal or "home" value of the vertical pan. 

Special information for the first and second sliders 
may include orientation (e.g., horizontal or vertical), 
the maximum range of the slider, the minimum range of 
the slider, the increment that the slider should move 
30 when selected by a user, a label for the minimum value; 
and a label for the maximum value. Specification 
information for the button component may include a 
state label to indicate the state of the button." A 
style value may also be registered as part of the 
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special information for a component. The style value 
may indicate which style of component to display, if 
multiple varieties are available. Such styles may be 
pre-defined, user-configurable, or any combination of 
5 the two . 



view the virtual representation of the device 32 in 
step 2110, a request may be made to web server 4 6 to 
view a virtual representation of the device 32 in step 

10 2115, Upon receiving such a request, web server 46 may 
retrieve the components of the device 32 registered by 
the device 32 with database server 48 in step 2120. 
The data retrieved by device 32 may also include a 
template document that was registered by the device 32'. 

15 The template document may be used to generate a web 
page displaying the resources and components in the 
format described by the template document. 



display components may be generated in step 2125. Once 
20 the display components have been generated, the display 
components may be displayed on web page 47 in the 
appropriate layout in step 2130, as determined by the 
template document. If a user indicates a desire to use 
a component in step 2135 (e.g., turn on a power button 
25 or decrease the brightness of a light), an appropriate 
command (or commands) associated with the desired 
command may be provided to the device. For example, if 
the device is a camera and a user desires to increase 
the brightness, the user may select the appropriate 
30 component (e.g., a slider) and execute the appropriate 
action (e.g., moving the slider by, for example, 
selecting it with a user input device (e.g., a mouse), 
and moving the slider in increasing increments) . In 
response, the command may be stored on the database 



In response to a user indicating a desire to 



Upon receiving the component data, the 
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server 48 in step 2150. The command may then be 
provided to camera device 32 in step 2160. This may be 
accomplished by, for example, packaging the changed 
resource or component as a command or other 
5 communication. 

When a user remotely controls a device 32, 
the commands may be entered into, for example, queue 51 
of FIG. 3. In some embodiments, queue 51 may be, for 
example, an advanced queue that operates as specialized 

10 memory and a separate dequeue process may manage 

retrieving commands from the queue in a non-first-in- 
first-out (non-FIFO) process for different devices, but 
in a FIFO process for commands for the same device. In 
some embodiments, multiple queues may be used for 

15 different devices, different users, or using any other 
suitable approach. Web page 4 7 (or other display) may 
indicate that a state change has been submitted and in 
the process of being executed. Subsequently, the 
device may in turn execute the command and increase its 

20 brightness level in step 2170. The camera device 32 
may then generate data indicating that the camera 
brightness has been increased in step 2180. 
Subsequently, this data may be retrieved by web 
server 46 in step 2190 and used to indicate that the 

25 brightness has been increased. This may be 

accomplished, for example, by indicating a percentage 
above the slider indicating the brightness of the 
camera, by sending an audible chime, by retaining the 
display of the slider as the user positioned it, or in 

30 any other suitable way. 

In some embodiments, a registration process 
may be used to allow the registration of new users,' 
monitoring modules, or available devices at remote site 
14. Using information from the registration process, 
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remote site 14 may provide the registered user with 
access to the functionalities of the registered 
monitoring module and registered devices. Users may- 
access the functionalities of the modules and devices 
5 via communications network 16. 

In some embodiments of the present invention, 
users may be required to create or open an account 
before installations, monitoring modules, devices, 
parameters, actions, and indicators, components, 

10 virtual representations, or other elements of the 

system that are associated with a particular user or 
entity may be registered with remote site 14. 
Subsequent access to the registered installations may 
be granted only to the user account holder or to those 

15 that the user account holder has permitted access. For 
example, the user or users of installation 12 may open 
an account with remote site 14 by accessing web server 
46 of remote site 14 via, for example, web browser 26. 
If desired, accounts may be opened using any other 

20 suitable approach, such as, for example, using a 
telephone, or mailing in a physical contract. 
Information provided for the purposes of opening an 
account with remote site 14 may be stored in database 
server 4 8 . 

25 FIG. 10 is a flowchart of illustrative steps 

involved in associating registered installations (and 
the registered elements making up the registered 
installations) with a particular user account. At 
step 306 a user account is created. Registration of 

30 the user's installations takes place at step 308. 

Step 308 may include steps 309 and 311. At step 309, 
appropriate database entries may be made in database 58 
that catalog the elements to be registered (which may 
effectively serve to register the elements at remote 
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site 14). At step 311, remote site 14 associates the 
registered elements with their corresponding user 
account. This may be done using any suitable cross- 
referencing technique. For example, in a relational 
5 database, a separate table may list all installations 
in one field and the corresponding user accounts in 
another field. Another table may list all 
installations in one field (that may act as a key field 
to the first table) and all associated elements in 
10 another field. This is merely an illustrative 

relational database structure for cross-referencing 
installations and their elements with corresponding 
user accounts. Any other suitable database construct 
may be used. 

15 Once the registration process is completed, 

the user account holder and those entities that the 
user account holder permits access to, may access the 
registered installations at step 310. 

Monitoring modules 28 may also register with 

20 remote site 14. Information regarding monitoring 
modules 28, such as model identification, attached 
devices, etc. may also be stored in database server 48. 
Once a monitoring module is registered, it may register 
its attached devices with remote site 14. Information 

25 associated with devices, such as device names, may be 
stored in database server 48 and made available to the 
user. Each device 32 may communicate with monitoring 
modules 28 and export its customized interface to 
database server 48. If the interface is not 

30 customized, a default interface may be used. 

The registration process of some embodiments 
of the present invention may require user interaction 
locally, remotely, or both. For example, the system 
may prompt users to enter registration information on a 
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web site that is resident on web server 46. The system 
may, for example, require users to set or adjust system 
settings using set-up software running locally on user 
access device 22. The set-up information may 
5 subsequently be communicated to remote site 14. Any 
suitable combination of local and remote registration 
processes may also be used. 

In some embodiments, the monitoring module 
may generate a globally unique monitoring module 

10 identification and a monitoring module password during 
the registration process. These are illustrated in 
FIG. 11. Every monitoring module 28 may have a model 
identification code, identifying the particular model 
of the monitoring module. During the registration 

15 procedure, or at any other suitable time, the 

monitoring module may generate a monitoring module 
identification 116 and a monitoring module password 
118. If desired, the monitoring module identification 
116 and a monitoring module password 118 may be 

20 predetermined and stored in memory in the monitoring 
module during the manufacturing process. The 
monitoring module identification may be unique to each 
particular monitoring module in the whole set of 
existing monitoring modules. .This is merely an 

25 illustrative embodiment of the monitoring module, and 
any other suitable embodiment may be used. 

Monitoring module 28 and remote site 14 may 
communicate using a communications protocol. The 
communications protocol between monitoring module 28 

30 and remote site 14 (e.g., via communication network 16) 
may consist of a series of predefined messages, message 
parameters, and return codes. The registration 
protocol may be a subset of this communications 
protocol and may be specific to the registration 
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process used to register monitoring modules and devices 
with remote site 14. 

Registration protocol messages may be 
initiated by the monitoring module. The monitoring 
5 module may, for example, generate a transaction 
identification for each message. The transaction 
identification may be an identifier that is unique 
within a given time window. Registration protocol 
messages may include, or be accompanied by, the 

10 transaction identification, model identification code, 
monitoring module identification, and monitoring module 
password. The registration protocol message may 
include commands and any required command-specific 
parameters. If desired, any suitable part of the 

15 system other than the monitoring module may initiate 
the communication of registration protocol messages. 
For example, the user may manually initiate the 
registration protocol messages using, for example, 
client device 22. 

20 Remote site 14 may process monitoring module 

registration messages and return confirmation messages 
to the monitoring module that initiated or generated 
the registration messages. The confirmation message 
may contain the original message's transaction 

25 identification, a version identification of the 

software being used at web server 4 6, database server 
48, or both, and the name or other identification of 
the command to which the confirmation is responding. 
If desired, confirmation messages may include any other 

30 identification information or other suitable 

information instead of or in addition to those 
described. 

Confirmation messages may also include an 
acknowledge character (ACK) to indicate remote site 14 
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processed the message correctly. When remote site 14 
cannot process the message correctly, for whatever 
reason (e.g., checksum error, invalid command 
parameter, etc.), confirmation message may include a 
5 negative-acknowledge character (NAK) code. The 

confirmation message may also include an error message 
that may indicate the reason for the NAK code. 

In one suitable approach, remote site 14 may 
have the ability to recognize certain errors, forms of 

10 errors, or both. Remote site 14 may also correct the 
recognized errors. Instead of returning a NAK code in 
this situation, remote site 14 may return an ACK code 
with a notification of the detected error and the fact 
that it was corrected. Alternatively, remote site 14 

15 may only return an ACK code without the acknowledgment 
that an error was corrected. Any such suitable 
response may be used. 

If desired, multiple registration protocol or 
other messages may be sent using only one 

20 communication. This may be accomplished using any 

suitable technique. For example, the messages' may be 
bundled into an extensible markup language (XML) 
command schema. Remote site 14 may, likewise, respond 
to the bundled message communication in one XML 

25 confirmation schema. Alternatively, remote site 14 may 
provide individual responses for each command in the 
original communication . 

FIG. 12 is a flowchart of illustrative steps 
involved in the registration process in accordance with 

30 an embodiment of the present invention. It should be 
understood that the steps shown in FIG. 12 may be 
altered in any suitable way. For example, steps may be 
added, deleted, or performed in any suitable order. 
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FIG. 12 is merely an illustrative embodiment 
of the registration process. Any suitable 
modifications may be made in accordance with this' 
embodiment of the present invention. In the first 
5 series of steps 100, the monitoring module may generate 
a monitoring module identification, a monitoring module 
password, a model identification code, and a 
transaction identification. Registration information 
from devices 32, coupled to the monitoring module may 

10 be extracted. These pieces of information may be 

included in a registration message that is communicated 
to remote site 14 by monitoring module 28 at step 102. 

At step 104, remote site 14 may check the 
validity of registration messages, of command (or 

15 commands) included in the registration messages, or 
both. Checking message validity may include, for 
example, checking whether a message has a transaction 
identification that is unique within the agreed upon 
time window; checking whether a message includes a 

20 unique monitoring module identification and a 

monitoring module password; and checking whether a 
message includes a model identification code. If 
desired, any other suitable technique may be used in 
checking message validity. Checking message command 

25 validity may include, for example, determining whether 
a command is one that remote site 14 is able to 
recognize (i.e., is an actual predefined command); and 
whether a message includes the correct command 
parameters for the command used. If desired, any other 

30 suitable technique may be used in checking message 

command validity. If desired, remote site 14 may also 
check for command specific validity. This may involve, 
among other things, ensuring that any contingent 
devices have already been registered, checking to make 
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sure a device that is to be registered has not already 
been registered, and any other suitable validity 
checks. FIG. 13a shows illustrative commands, 
corresponding command parameters, and corresponding 
5 command validity checks for the registration process. 
If desired, any other suitable commands may be used. 



register the installation, including the monitoring 
module, devices, resources, components, virtual 

10 representations, and. any other suitable elements of the 
installation. If desired, any of the elements may also 
be registered separately from other elements. Remote 
site 14 may also associate the registered elements with 
the corresponding user account. Registering monitoring 

15 modules 28 and devices 32 may include, for example, 

adding the identified monitoring module, devices, user, 
or any other suitable information contained in the 
registration message, to a database at remote site 14. 
Remote site 14 may then generate a confirmation message 

20 that includes, in the case of no errors, an ACK. When 
errors are encountered during the registration process, 
remote site 14 may return a NAK. At step 106, the 
confirmation message may be transmitted from remote 
site 14 to the monitoring module. At step 108, the 

25 monitoring module checks the confirmation message. If 
a NAK is found, then the monitoring module may 
retransmit the registration message at step 112. If an 
ACK is found then the registration is deemed to be 
successful at step 110. 

30 Information regarding registered monitoring 

modules and registered devices may be stored in the 
database. Remote site 14 may access the database to 
K retrieve information about the registered monitoring 
module (or monitoring modules) and registered devices. 



If there are no errors, remote site 14 may 
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The system may provide the user with the ability to set 
preferences for the registered devices, gather 
information from the registered devices, and control 
the registered devices. The database may allow for an 
5 efficient mechanism by which information about devices 
may be accessed and provided to the user. An 
illustrative database schema is shown in FIG. 13b. If 
desired, any other suitable schema may be used. 

When a user registers with remote site 14, a 

10 number of table entries in the database may be created. 
The user's personal information, billing information, 
the monitoring module's unique monitoring module 
identification, the monitoring module password, and any 
other suitable data may be stored in the database. 

15 Entry of the data into the database may be facilitated 
by using an appropriate database application program 
interface (API), such as, for example, an API with a 
data parameter that may create a data cell and store 
the content of the data parameter in the data cell. 

20 Thus, only a single function call may be needed for 

entering a piece of data into the database. Once a new 
user is added to the database, the function may return 
a user identification code or number. This user 
identification may be used by the system to refer to 

25 the user rather than having to use the user's name. 

The process for adding entries for monitoring 
modules and devices in the database may be similar to 
the process for adding entries for users. That is, 
using APIs, new table entries may be added in the 

30 database. When registering new monitoring modules and 
devices, only a single function may need to be called 
by web server 46 to create the appropriate table 
entries in database 58. The appropriate table entries 
may be created and the appropriate identification codes 
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or numbers may be returned- If desired, any other 
suitable technique for adding entries for monitoring 
modules and devices in the database may be used. 

When processing validity checks, web server 
5 4 6 may query the database to determine whether certain 
entries are already in existence. For example, when 
registering a new device, a function may be called by 
web server 46 that returns a boolean value 
corresponding to whether or not the device already 

10 exists in the database. This querying process may be 
performed using suitable API's. 

In another suitable embodiment of the present 
invention, the registration process may be layered with 
sub-registration processes for registering users, 

15 registering installations associated with their 
respective users, registering monitoring modules 
associated with their respective installations (and, in 
turn, associated with their respective users) , 
registering devices associated with their respective 

20 monitoring modules, registering resources associated 
with their respective devices, registering components 
associated with their respective resources, and 
registering virtual representations which are made up 
of components to provide a virtual device. 

25 The registration process for each of these 

layers may include registration information being sent 
from the monitoring module to the remote site, 
including suitable registration commands and parameters 
(e.g., addComponent (Resource, monitor ingModule, 

30 component Type, etc.)). Registration messages for the 
different layers may be generated using a markup 
language (e.g., HTML). For example, HTML form post 
commands with name/ value pairs may be used in the 
registration message. When the registration message is 
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communicated to the remote site, web server 46 may 
process the registration message by parsing the markup 
language code. Appropriate entries may be made into 
database 58 at remote site 14 to catalog the registered 
5 elements of an installation. 

Each registered element may be assigned a 
suitable identification code by remote site 14 that may 
be used to identify at remote site 14 the element 
within a particular installation. In one suitable 

10 approach, monitoring module 28 may assign an 

identification to an element of installation 12 that is 
unique only to installation 12 or to monitoring module 
28. The identification assigned by monitoring module 
2 8 may or may not be made identical to the 

15 identification code assigned by remote site 14. In the 
approach where the identifications are different, the 
identification code assigned by remote site 14 may be 
mapped to the identification assigned by monitoring 
module 28 (e.g., using appropriate database 

20 constructs) . When communicating with monitoring module 
28 regarding a particular element, remote site 14 may 
look up the mapped identification assigned by 
monitoring module 28 and communicate using that 
identification. In the case where the remote site 14 

25 and monitoring module 28 use the same identification, 
the identification assigned by remote site 14 may be 
returned to monitoring module 28. Monitoring module 28 
may use the identification in subsequent communications 
with remote site 14 when referring to the element of 

30 installation 12 with which identification is 
associated. 

For example, in some embodiments the 
parameters, actions, indicators, resources, components, 
templates, or a combination thereof, associated with a 
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device 32 may be registered by the device 32 in 
database server 48 during the registration of the 
device 32. By allowing a device to auto-register such 
information, web server 4 6 may generate a predefined 
5 virtual representation from data supplied by database 
server 48, without knowledge of particular parameters, 
actions, indicators, resources, components or 
templates. More specifically, the database server 48 
may include code that stores and retrieves parameters, 

10 actions, indicators, resources, components or templates 
associated with a device, without knowledge of such 
information. This may provide greater flexibility and 
manageability of the web server, since it need not be 
updated to include code to process newly developed 

15 devices with new parameters, actions, indicators, 

resources, components or templates. For example, if a 
new device is to be registered, such as a garage door 
opener, it may not be necessary to generate code for 
the database server 48 to process all of the 

20 parameters, actions, indicators, resources, components 
and templates for that device. 

In some embodiments, the parameters, actions, 
and indicators associated with a device may be included 
with registration information and registered with 

25 database server 48. FIG. 14a depicts illustrative 

steps involved in registering the parameters, actions, 
and indicators associated with a device. Parameters, 
actions, and indicators associated with a device may, 
for example, be stored on the device itself. 

30 Accordingly, in step 2001, these parameters, actions, 
and indicators may be transmitted from the device to a 
database server. Alternatively, an Internet address 
may be stored on the device where the parameters, 
actions, and indicators may be retrieved. Accordingly, 
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in step 2002, this Internet address (or Internet 
addresses) may be transmitted from the device to a 
database server. In step 2003, the parameters, 
actions, and indicators located at that Internet 
5 address may be downloaded to the database server. 

Alternatively, parameters, actions, and indicators may 
be supplied by a client access device. The parameters, 
actions, and indicators may have been supplied to the 
client access device by any appropriate means. For 

10 example, the parameters, actions, and indicators may be 
downloaded by the client access device from a remote 
device, may be read from a floppy disk, a CD-ROM, DVD- 
ROM, or any other appropriate storage device. 
Accordingly, in step 2004, the parameters, actions, and 

15 indicators may be transmitted from the client access 
device to the database server. 

FIG. 14b shows illustrative steps that may be 
involved in registering the components, resources, and 
templates associated with a device. Components, 

20 resources, and templates associated with a device may, 
for example, be stored on the device itself. In step 
2101, these components, resources, and templates may be 
transmitted from the device to a database server. 
Alternatively, an Internet address may be stored on the 

25 device where the components, resources, and templates 
may be retrieved. Accordingly, in step 2102, this 
Internet address (or Internet addresses) may be 
transmitted from the device to a database server. In 
step 2103, the components, resources, and templates 

30 located at that Internet address may be downloaded to 
the database server. Alternatively, the components, 
resources, and templates may have been supplied by a 
client access device. The components, resources, and 
templates may have been supplied to the client access 




- 51 - 

-device by any means desirable. For example, the 
components, resources, and templates may be downloaded 
by the client access device from a remote device, may 
be read from a floppy disk, a CD-ROM, DVD-ROM, or any 
5 other appropriate storage devices. Accordingly, in 

step 2104, the components, resources, and templates may 
be transmitted from the client access device to the 
database server. In some embodiments, a combination of 
these approaches may be used. 

10 In some embodiments of the present invention, 

events may be registered at a remote site. An event 
may be specific to a particular device. For example, 
"FIRE!!!" may be a unique event to a fire alarm device, 
whereas "door motion sensor tripped" may be a unique 

15 event to a door motion detector device. Any such 

suitable events may be associated with their respective 
suitable devices. 

In some embodiments of the present invention, 
as new devices are added to a registered monitoring 

20 module, the monitoring module may automatically (i.e., 
without any user interaction) detect the presence of 
the new devices and automatically notify remote site 14 
of the presence of the new devices. Remote site 14 
may, in turn, add the new devices to the database. In 

25 order to determine when and which new devices are 
added, the monitoring module may conduct object 
discovery on a continuous basis. If desired, the 
object discovery may be conducted on a periodic basis. 
Once new devices are found, the monitoring module may 

30 send a registration message to remote site 14. 

In some embodiments of the present invention 
an installation 12 may be re-registered. For example, 
in the case where a system crash occurs at an 
installation 12, or if the hardware, software, or both 
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is upgraded at the installation (or at the remote 
site) , the installation may need to be re-registered. 
Re-registration may be necessary for any suitable 
reason. The process for re-registration may be 
5 substantially similar to the initial registration 
process for an installation, monitoring modules, 
resources, components, and virtual representations. 

In one suitable approach, remote site 14, 
remote user access devices 17, or any other suitable 

10 remote elements of system 10 may access installation 12 
or any of the elements of installation 12 using a 
special address (e.g., IP address) that is associated 
with a particular installation 12 or with a particular 
element of installation 12. The special address may be 

15 communicated from the corresponding installation or 
element of an installation during the registration 
process . 

In other suitable embodiments, a device may 
be automatically detected. Automatic detection of 

20 devices may be implemented using any suitable software, 
hardware, or both that may allow devices coupled to a 
monitoring module to be automatically detected. The 
approach employed for implementing automatic detection 
may depend on whether there is one-way communications 

25 between devices 32 and monitoring module 28 (i.e., from 
devices 32 to monitoring module 28) or whether there is 
two-way communications . 

In one suitable approach monitoring modules 
may continuously, periodically, or in response to one 

30 or more particular events, attempt to handshake with 
devices. This is illustrated by FIG. 15a. The 
monitoring module may send a handshake message through 
all of its interface ports (e.g., USB, parallel, 
serial, IEEE 1394, infrared, proprietary, and any other 
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suitable wired or wireless based port) in an attempt to 
reach all devices that may possibly be coupled to the 
monitoring module (step 200) . The monitoring module 
may use any suitable algorithm in sending handshake 
5 communications to its interface ports. For example, 
the communications may be sent sequentially, using 
round robin, weighted fair queuing, or any other 
suitable algorithm. If a device is coupled to the 
monitoring module the handshake communication may be 

10 sent to the port to which the device was connected 

(step 202) . At step 204, the device may respond to the 
handshake communication (e.g., with another handshake 
communication) . If a response is received by the 
monitoring module, then at step 206, the device that 

15 communicated the response is detected by the monitoring 
module. The monitoring module may then request 
additional information from the detected device (e.g., 
to use in the registration process) . If no response is 
received from a particular port, then a device is not 

20 detected at that port. 

If devices are daisy-chained, the handshake 
may be passed on from one device to another in the 
chain. Responses from the daisy-chained devices may be 
returned from one device to the next until the 

25 responses reach the monitoring module. 

The use of handshakes is merely an 
illustrative approach for the automatic detection of 
devices. Any other suitable approach may be used. For 
example, a monitoring module may check its ports to 

30 determine whether any data streams are coming into the 
ports. For example, in the case where the device is a 
video camera, a constant video feed may be communicated 
from the video camera to the monitoring module. If 
there is a data stream coming in, then the monitoring 
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module may acknowledge that a device is coupled to that 
port- FIG. 15b illustrates this method of automatic 
detection of devices. At step 208 a device may be 
coupled to the monitoring module. The device may 
5 transmit a data stream at step 210. At step 212, the 
monitoring module may check ports for data streams and 
may detect a data stream (step 214) at the port 
corresponding to the device. 

In another suitable approach, devices may be 

10 configured to periodically, continuously, or upon 
particular events (e.g., power-up, user pressing a 
button, or any other suitable event) send a message 
through their respective connection interfaces, 
identifying themselves. For example, each device may 

15 have a user interface such as a button that a user may 
need to interact with (e.g., pressing the button) in 
order for the device to be detected. For example, upon 
user interaction, the device may send a communication 
to its corresponding monitoring module. The 

20 communication may be any suitable communication that 
may allow the monitoring module to detect the device. 
In one suitable embodiment, the communication may 
include a serial number associated with the device. 
The serial number may be used by the monitoring module 

25 to identify the device in subsequent processes. If 
desired, this approach may be used with wireless 
devices (i.e., devices 32 that communicated with 
monitoring module 28 via a wireless interface such as 
Bluetooth) , while wired devices may be detected using 

30 any other suitable method. 

Any other suitable approach for the automatic 
detection of devices may be used. For example, the 
monitoring module may detect whether electrical current 
is flowing through device ports as a means of detecting 
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devices (in the case of wired devices) . In such an 
embodiment, the device may change the state of an 
interface element (e.g., a connection pin) between a 
high value and a low value depending on whether power 
5 is being sent through the port to the device. For 

example, if a video camera is coupled to the monitoring 
module, the video camera may be automatically powered 
by the current from the monitoring module. The flow of 
current may cause the value of a particular connection 

10 pin to change from low to high. The monitoring module 
may detect the high value of the particular connection 
pin, thus indicating the presence of a device. 

In another suitable approach, the devices and 
monitoring modules may be configured according to hot- 

15 plugging standards (e.g., that make use of IEEE 1394, 
USB, PCMCIA, or any other interface that accords with 
hot-plugging standards) . Any such suitable approach 
may be used. 

In some embodiments, a detected device may 

2 0 communicate a unique string to the monitoring module. 
The unique string may be used by the monitoring module 
to detect the device or the unique string may be 
communicated subsequent to the detection of the device. 
The unique string may contain a uniform resource 

25 identifier (URI), such as, for example, a uniform 

resource locator (URL) . The URI may provide a link to 
a downloadable object, such as, for example, a remote 
method invocation (RMI), a common object request broker 
architecture (CORBA) object, a distributed component 

30 object model (DCOM) object, a device driver/device 

descriptor, or any other suitable downloadable object. 
The downloadable object may be acquired by monitoring 
module 28 (using, for example, communication network 
16) . The downloadable object may be installed at 
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monitoring module 28. The object may be executed and 
may take responsibility for running the corresponding 
device, registering parameters, registering events, 
registering components, or for performing any 
combination of these or any other suitable functions. 

FIGs . 16-23 are illustrative displays that 
the system may provide to the user during the 
registration process. Although the displays shown in 
these figures are shown as web pages, it should be 
understood that the displays need not be limited to 
being displayed in a web browser or using an Internet- 
based or client-server based approach. For example, 
the displays may be generated by web server 46. 
FIG. 16 shows an illustrative service agreement display 
that the system may provide as one of the first screens 
in the registration procedure. When the user agrees to 
the terms of the service agreement, the system may then 
prompt the user for personal information as shown in 
FIG. 17. The system may, for example, prompt the user 
for a login identifier and password. 

The system may also provide users with the 
opportunity to edit preferences for registered devices. 
For example, the system may provide users with 
opportunities to set up special notification 
preferences for particular devices. FIG. 18 shows an 
illustrative display. The display shows a listing of 
event descriptions and the corresponding- notifications 
set up for each event description listing. The user 
may be given the ability to edit the notification 
action . 

The system may provide the user with 
opportunities to set names or identifiers for 
monitoring modules and/or connected devices. FIG. 19 
shows an illustrative display listing devices for a 
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particular installation and the devices 1 corresponding 
names and/or descriptions. The system may provide the 
user with an opportunity to enter names for' the 
monitoring module, the devices, or both, during the 
5 registration process. If desired, an entire 

installation may be given a name chosen by the user. 
FIG. 20 shows an illustrative display that prompts the 
user for an installation name. 

If desired, the system may provide displays 

10 instructing users how to connect various devices and 
how to register them with remote site 14. FIG. 21 
shows an illustrative display having instructions on 
how to connect a camera to the monitoring module in 
order for the camera to be automatically detected and 

15 registered with remote site 14. 

FIG. 22 shows an illustrative display showing 
which devices have been detected. The registration 
process may provide users with opportunities to set up 
or customize the detected devices in any suitable way. 

20 For example, the system may allow the user to rename 
any device, as in the illustrated example, to set 
parameters for detected devices (e.g., setting a 
digital camera's resolution, setting default settings 
for device, etc.), or to customize the devices in any 

25 other suitable way. 

Other information that monitoring module 2 8 
may supply to remote site 14 during the registration 
process may include information about the type of 
communications network 16 being used by the client 

30 access device to communicate with remote site 14. 
FIG. 23 is an illustrative display that may be 
displayed for the purpose of requesting this 
information. Any suitable information may be supplied 
to remote site 14 during the registration process, 
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including, for example, information regarding client 
device 22, parameters for devices 32, and information 
regarding any particular software or hardware component 
of installation 12. 



representing devices at remote sites are provided- One 
skilled in the art will appreciate that the present 
invention can be practiced by other than the described 
embodiments, which are presented for purposes of 
10 illustration and not of limitation. 



5 



Thus, systems and methods for virtually 



